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ABSTRACT 

o 

A description is given of the data hase used in the perception subsystem of 
the Mars robot vehicle prototype being implemented at the Jet Propulsion Labora- 
tory. This data base- contains two types of information. The first is generic 
(uninstantiated, abstract) information that specifies the general rules of per- 
ception of objects in the expected environments. The second kind of information 


the properties 
The generic 


is a specific (instantiated) description of a structure, i.e. 
and relations of objects in the spedific^ Case being analyzed. 

/j , . ■ , " 

knowledge can be used by the approximate reasoning subsystem to obtain informa- 
tion on the specific structures which is not directly measurable by the sensory 
instruments. Raw measurement S';sare input either from the sensory instruments or a 
human operator using a CRI^ or a TTY. : ■ 

. V _ ; > 

The generic rules of perception are substantially a model, representing the 
statistics of the environment relating the properties of objects, and relations 
betweep. objects . The description of a specific structure is. also npndeterminis- 
tics in the sense that all properties and relations may take a range of values 
with an associated probability distribution. 
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I. INTRODUCTION 


The modeling of systems is the goal of most scientific disciplines etfid 
endeavors. A good generii; (abstract or unlnstaintiated) model is compact and con- 
cise. It can be used to analyze the mewing of a particular state of the environ- 
ment and to anticipate l;s behavior. The traditional method of modeling in the 
mathematical physi,cal sciences is the use of a set of deterministic axioms ex- 
pressed in mathe-Tiatical logic. This approach was used successfully in generation 
and analysis of mathematical and physical models and theories. Unfortunately, 
attempts to use this method of representation by computer programs for automatic 
reasoning (Ref. 1; Ref. 2, Chaps. 6, 7, 8) ran into the problems of computational 
impracticability as was foreseeable in hindsight from complexity theory (Ref. 3). 

In addition to the inherent computational impracticability of the use of nontrivial 
axiom systems, most rules in the real world are nondeterministic. That is, for 
almost a].l rules, exceptions can be found. 

Since logic-based (deterministic) rule systems were found to be impractical, 
attempts to implement practical nondeterministic inference systems were made 
(Refs. U, 5). 

This article presents our approach to the representation of nondeterministic 
generic rules, the representation of nondeterministic facts about the specific 
cases being analyzed, and the approximate reasoning process which applies the 
generic information to obtain more information on the specific cases. In some 
sense, we integrated semantic net approach with sequential decision theory. The 
semantic net approach contributed flexible hierarchical organization, while the 
sequential decision theory contributed flexibility by use of probabilities and 
systematic control structure. 

Researchers in scene analysis used or suggested use of the data base 
approach (Ref. 6), the semantic base approach (Ref. U) or deterministic hier- 
archical structures (Ref. 7» 8, 9) before. However, it appears that our system 
is a step forward in providing for powerful control and rule-based probabilistic 
inference under time constraints in a way which was not attempted before and 
which seems to be potentially and practically useful. 

The data base is implemented in SAIL, an algol-based associative data base 
language for the DEC PDP-10 computer. The machine being used at the present is 
the Caltech PDP-10, but implementation started on the Stanford Artificial Intel- 
ligence Lab. PDP-10. The sensory instrument, e.g., the stereo pair of TV cameras 
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and laser range finder (Fig. 1) are controlled and Interfaced to the real time 
minicomputer GA SPC-I 6/85 (see Fig. 2). llje Caltech PDP-10 can control the 
SPC-I 6 via telephone line, and mar..' of the preprogrammed attributes (feature 
extractors) are implemented as low-level image analysis routine on the 
SPC-I 6 . The SAIL language is described in Refs. 10 and 11. 

The sensory system itself and Icw-level routines for feature extraction out 
of images are described in Refs. 12 - 13 • Appendixes A and B contain a self- 
contained description of a simple application of the data base in the analysis 
of the traversibility (safety) of area for the vehicle. It nuiy be helpful to 
refer to these appendixes at this point. 

II. ENVIRONMENT DESCRIPTION - SPECIFIC STRUCTURE REPRESENTATION 

In the abstract, a specific structure (an analyzed case) can be represented 
as a set of objects, properties of those objects and relations between objects. 

Ovir domain of specializations is the representation and the analysi*' of pictorial 
Information. Appendix 1 explains a computer printout of a generic model, and 
Appendix 2 describes a computer printout of a specific model. Both of these models 
arc dedicated for the analysis of traversibity of areas by a robot vehicle. 
Typic6d.ly, when modeling the VISUAL WORLD in an atten^t to understand pictures 
there are the following classes of objects: (1) scenes (picture freunes), (2) 

three-dimensional bodies, (3) two-dimensional regions (pictorial images of 
three-dimensional surfaces), (U) one-dimensional lines, (5) one-dimensional 
boundaries between regions, (6) vertices, and (7) 3-D surface sample point, etc. 

In each specific Instance of the environment (in vision research it will 
be a specific picture frame), there appear a few objects of those types. Each 
one of these objects has propeirtles and is related to other objects. Figure 3 
gives a partial, data structure describing an image. 

A. OBJECTS AND CLASSES 

The list of possible "classes” of objects -is predetermined by the reper- 
toire of the generic model. When representing an instance structure, each 
"class” is a "set" data structure. Such a "set” is a data structure containing 
an unsorted list of nonrecurring pointers to the data structures representing 
the known objects of that class in the bi''cific structure. For Instance, the set 
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Fig. 1. Robot system eonl’dguration 
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Fig. 2. Hardware configuration: two cameras and arm 
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CUSSES OF OBJECTS: SCENES, REGIONS, BOUNDARIES, VERTICES 
OBJECTS 

" OF CLASS SCENES: ^ 

OF CLASS REGIONS; R,, Rj, R3, R^ 

OF CLASJ^ BOUNDARIES: Bjy 8,3, B,^, Bjg,. 63^ 


OF CLASS VERTICES: V,, Vg 


FEATURES 


OF REGIONS: SIZE, GRAY LEVEL, LABEL 
OF BOUNDARIES: LENGTH, AVERAGE DIFFERENCES 


RELATIONS " 

REGIONS IN: SCENES 

BOUNDARY OF: REGION 

ADJACENT;'^'' REGION 

COMPOSES; VERTEX 


REGIONS 

BOUNDARY 

REGION 

BOUNDARY 


PROPERTIES; 


SIZE ® R^s (10 

1 . 0 ) 

® 'r (:Sd- ;I) 

RELATION - OBJECT LIST: 

7^12 

BOUNDARY OF (g) 

R, s B ,3 

COMPOSES ® 

/'13 

V, s B 23 


REGIONS IN (X) P, 


Fig. 3^ Partial representation of a 
segmented sc er;e . - 4 . . 
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associated with the class ''regions" when representing the model in Fig. 3 will 
contain pointers to regions R^, R^j and R^. The object data structure itself 
is an item containing the ob\''sct's name (for man-machine interaction), the name 
of its class and some basic preprogrammed properties. Usually each object in a 
structure is in relation "part of" with a global object (the "scene" in the visual 
pictures case). The global object allows the definition of global properties 
like lens iris setting, camera position, and external lighting conditions which 
affects the analysis of all substructures. 


B. REPRESENTATION OF PROPERTIES 


The generic model of the environment defines a set of attributes that are '■ 
functions that act on elements of a specified class and map into the integer 
domain. For example, the following are some of the attributes which apply to 
objects of class regions: "area," "color," "average light intensity," "shape." 
AttritiJutes which apply to objects of type boundary include "length," "difference 
in light intensity across %he boundary line," etc. 

The value of an attribute when applied to^an object is a property of the 
object. For instance, application of the^ attribute "area" to region R^ may 
result in the value 7, which is a property of R^. 

The representation of properties is made a bit more complicated, because 
measurements may be unreliable and take a range of possible values. For instance, 
estimating the "label" (meaning) of the body imaged on R^ may be speculative. To 
r^i^-fepresent ^ambiguity, properties are allowed to take range of values with an 
associated probability estimate of the validity of that value. 

The association of attribute, 'object, and property is represented by the 
associative data structure of SAIL, and may look like this: 




This will mean that the current estimate of the area of R^ is l6 with 
probability 0.05» 15 with probability 0.9» and l4 with probability 0.05. Note, 

il) 

that the probabilities add up to one. This is so because the~property values q - 
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are assuraOd to be mutually exclusive (e.g. , one and only one value is actually 
true even though we cannot tell which one). 


The properties data structure is further con^jlicated by two factors . 

First, a property may change in time; hence, some estimate on the period of valid- 
ity of that property must be given. Secondly, often the reliability of the esti- 
mate of a property depends on the resources spent in measurement and analysis. 
Hence, an indication of; (l) the amount of resources Ceompute time) allocated 
to obtaining the specific property, (2) the amount of resources actually used to 
obtain that estimate, and CS) the real time when the estimatefwas obtained is 
associated with the property''' estimate. As a result, the property data structure 
(the item's content, which is. a linear array here) contains the following 
information; 

(1) Start of validity period date. 

(2) End of validity period date. 

(S9 Date when the estimate was computed. 

(4) Resources allocated to obtain the property's estimate. 

(5) Resources used to obtain the "estimate. 

(6) Last access date - used by the "forget” mechanism to release storage 
taken by unused information. 

(7) Estimated values list. 




a 

(more compact representation of the 
probability distribution of values 
is used when practical) 


All dates are measured in absolute time, and stored in standard PDF- 10 
format in a 36-bit word specifying the date and time of day down to about a third 
of a second accuracy. If a property is assumed constant in the effective time, 
the validity dates may be set to -“ or to '+“ to indicate permanency in one or two' 
time directions in the scope of the analysis. jj, V' 
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Resources are measured in the number of milliseconds of compute time that 
were used or were allocated to be used to obtain that estimate. 

There can be more than one property associated with a pair of an attribute 
and a specific object. For instance, the color of an object may be blue from 
06 ^ to IT"^, red from to 1&^, and black afteirwards in the period of inter- 

est. The associative storage mechanism of SAIL provides for that type of multi- 
plicity of associations of few properties with a single pair of an attribute and 
an object. 

Attributes values (properties) and relation values (object lists) can be 
put in manually in the specific model data base as training samples for a learn- 
ing process where the generic model is being improved or analyzed. Such proper- 
ties are marked as "special" knowledge for training purposes. The learning proc- 
ess is not described at all within the scope of this article, and no further 
reference to that point will be made. 

C. REPRESENTATION OF VALUES OF RELATIONS (OBJECTS LIST) 

A num>>er of relations are defined for each class of objects in the generic 
model. The value of a relation applied to an object o'" the appropriate class 
will be a list of objects all of one class (possibly different from the class of 
the object operated on) which satisfy the relation. For instance, "boundary of" 
will be a relation which operates on object of class "regions" and will come 
back with a list of objects of class "boundary lines" which are boundaries of 
that region. 

The limitation that relations apply to one object at the time was imposed 
to simplify implementation. 

In general, relations are n-ary, not binary, as in the present implementa- 
tion; that is, the relation is between more than two objects. The limitation may 
be bypassed by defining "combination" objects; that is, define an object class 
whose elements stand for an ordered list of a fixed number of simpler objects. 
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Typically, application of a relation to an object results in the following 
association being put in the data base: 


Relation object ^ = 


"object^ 
object^ Wg 
object 2 


I objectj^ Wjj 


The relation is the name as defined in the generic model. Object^ is an Instance 
of an object of the class of objects upon which the relation works. Each one of 
object^ (1 ^ i £N) is estimated to satisfy the relations with the .-orresponding 
probability V/^. In fact, the relations values define fuzzy sets (Ref. l6). 

All of these objects belong to the same class of objects which is the range of 
the relation. Clearly, N varies with different applications of the relation. 

We also imposed the constraint that the must be higher than 0.5; otherwise, 
the corresponding object is not included in the list to save storage. Note that 
the W^'s do not have to a^la up to one. There may be cases where more than one 
object satisfies the relation, e.g., the objects which satisfy a relation are not 
mutually exclusive. In other cases the list is empty; that is, no object appears 
to satisfy the relation. The distinction between operators which have mutually 
exclusive values (attributes) and others (relations) is important. Failure to 
account for these two types of operators results in mathematical logical distor- 
tions when the modeling process is bent to fit reality (Ref. 5). 

As is the case with properties, the "list" of objects which satisfy a cer- 
tain relation is time and resource dependent. The more the resources are 
expanded for searching for such objects, the more of them are likely to be found. 
Similarly, the period of time during which the relation will be valid may be 
limited. As a result, the data structure of the object list also contains the 
following information: 
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(1) Jtart of validity period date. 

(2) End of validity period date. 

(3) Approximated date when list was computed. 

(U) Type of computation. 

(5) Resources (compute time) allocated to obtaining the list. 

(6) Resources used in obtaining the list. 

(7) Last access date (used for storage cleanup). 

There are two types of evaluations of relations. The first corresponds to 
the existential quantifier (I) in logic. This existential search tries to find 
an object which satisfies the relation with high enough probability as specified 
in the call, and it terminates successfully as soon as one is found. The second 
type of evaluation is an exhaustive search. Its aim is to find as many objects 
that satisfy the relation with high probability within the bound of the 
resources allocated. The object list contains also a mark as to which type of 
search was used to obtain it. 

There is an indirect call on relations which retiirn a property-like value. 
This is a filter call. It operates on a pair of objects (object^, object^) and 
it takes only two values, 0 or 1. It takes the value 1 if object^^ appears to 
satisfy the corresponding relation to object^ and 0 otherwise. 


Example : 


Filter (Relation^^, object^, object^, res) 


0 O.U' 

1 0.6 


is equivalent to 
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Relation Object^ 


ObJectj^ 0.6 


III. THE GENERIC MODEL 

The generic* model does not describe an instance of the environment fa spe- 
cific structure) but contains information on general rules that objects suid 
structures in the environment will generally satisfy. The generic model is 
designed so as to allow direct use of the rules to compute properties and find 
objects which satisfy certain relations when this kind of information is 

quested by a user. ) 

The basis of the knowledge representation in the generic model is, of 
course, the repertoire of: (l) classes of objects, (2) attributes of those 

objects, and (3) relations. With each attribute and relation, there is an 
associated algorithm which, when applied to an object of the adequate class, will 
come back with the value. These algorithms are constructed so that thej may use 
only the resources (compute time) available to get an estimate of the value of 
the relation or attribute. 

At the present the rules are man-made. Using a special interactive editor, 
experts generate and update the information contained in the rules expressed in 
the formats described later. The data base system was designed with the intent 
that it will be expandable to include a statistical learning subsystem. When 
the learning subsystem will be implemented, the rules will be largely machine 
generated. The learning subsystem will integrate principles of adaptive learn- 
ing (Ref. IT) with statistical structure learning (Refs. 18, 19) • 

A. ATTRIBUTES 

The data structure of each attribute contains information defining the 
class of objects it operates on and the range of (integer) values that it can 
take . 
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There is an option to associate a name (an alpha-numeric string) with some 
or all of the integer values that the attribute can teike. These names are 
intended to facilitate man-machine interaction when properties are transmitted 
to or received from human operators. Similarly, the attribute names are selected 
so that they will be self-explanatory as to their semantic meaning. 

There are three types of attributes as determined by the type of the unique 
algorithm that is associated with the attribute and which is used to compute the 
properties of objects. The first type is programmed. Here, a preprogrammed 
routine is used tu compute the value of the attribute when applied to an object. 
Mauiy of .hesr- properties are actually stored in the data structure of the object 
itself in which case they are not saved in the associative storage. These rou- 
tines typically control directly the sensory instruments interfaced to the real 
time computer (SPC-16/05) and perform what we call low level analysis. We dis- 
tinguish between preprogrammed attributes implemented on the SPC-I 6 and the 
PDP-10. The second type of attributes are those whose values are obtained from 
a human operator or experts. When the value of one of those attributes for an 
object (the property) is required, the system issues a console (teletype or CRT) 
message requesting those values from the operator. The text of the message with 
blanks to be filled with the object names is stored in the data structure of the 
attribute. The last type of attribute is that which is evaluated by the inference 
system using the classification tree (the probabilistic semantic net) associated 
with the attribute. A unique dedicated classification tree is associated with 
each such attribute. Tliis tree represents a sequential classification process. 
When a property of an object (the value of an attribute) of that type is 
requested, the property is estimated by classifying the object into one of few 
small categories of objects of that class, using other (hopefully simpler to 
obtain) properties. For each of the small categories, the generic model has an 
estimate of the property distribution for objects in that category. That dis- 
tribution estimate is then taken as the property of that object. The sequential 
classification tree can be easily edited to obtain finer categories and to update 
the estimates of the distribution of the property for objects in the category. 

This facilitates learning of the generic model. More detail on the classifica- 
tion tree data structure is given below. 
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B. 


RELATIOHS 


The data structure of a relation specifies the class of objects it operates 
on and the class of objects on which it ranges. As is the case with attributes, 
there are three classes of relations as defined by the way they are computed. 

The first is the preprogrammed search where the search is done by a purely pro- 
grammed algorithm. The second kind of relation requires that the list of objects 
will be provided by the operator. The third kind of relations, which we call 
inference relations, is computed from other (simpler) relations by union, inter- 
section, and filtering the output of the simpler relations and attributes. The 
third type of relations is not yet fully developed in the existing system. 

The rest of this article describes the representation of the sequential 
classification process associated with computation of inferred attributes, 
followed by a description of the driver system, which computes values of 
attributes and relations. 

IV. INFERRED ATTRIBUTES - THE CLASSIFICATION TREE 

The essence of the inference process which computes the value of an inferred 
attribute applied to an object is classification of the object. The object is 
classified into categories such that the range of values of that attribute for 
objects in the small category is very limited and, hence, the property can be 
well estimated. 

Example ; Consider three-dimensional bodies in an environment where three- 
dimensional bodies may be labeled only oranges, bananas, or table tops. Then, 
without any test, the ^ priori probability distribution of the attribute "label" 
applied to an object of class "three-dimensional body" selected at random will be 
something like orange with probability 0.6, table with probability 0.3, and 
banana with probabiii'.y 0.1. 

If we break the class of "three-dimensional bodies" into two categories, 
the first category contains those objects which ha;'“ some planar surfaces, and 
the second category contains those objects which are purely curved surface. 

Then, the first category will include almost exclusively objects whose label 
takes the value tables, while the second category will be almost exclusively 
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bananas or oranges. Testing the color and shape of objects in the second 
category will edlow further subclassification of objectp In that category into 
finer subcategories, some almost exclusively containing objects labeled bananas 
emd the others almost exclusively containing objects labeled orcmges. 

The classification tree for an inferred attribute actually represents the 
classification process. The top node of the tree stands for the category of all 
objects of the class. With each node, there is am associated category of object 
and each son node stands for a (finer) subcategory of the category of objects in 
the parent mode. 

Each node contains the following information (to be described in more 
detail below): 

(1) Calling attribute . Each node is part of a unique classification tree 
dedicated to one attribute. A pointer to that attribute Is contained 
in the node. 

(2) Default value . This is the distribution of the property over all 
objects which belong to the category associated with the node. This 
probabilistic information can either put in manually or can be 
collected by going over (manually) emalyzed examples and counting the 
distribution. If the inference algorithm reaches the node without 
sufficient resources to expand the node this estimate is returned as 
the answer. If there is not a default estimate (insufficient train- 
ing set or too wide range of values to be stored practically), a 
marker to that effect is put in. 

(3) Node expansion plan (optional) . This information designates either 
how to get a finer classification of the objects in the node's 
category so as to get a better estimate of the property or how to 
get a better estimate of the property directly without finer clas- 
sification. Finer classification is obtained by selecting sons 

of the node which stand for subcategories of the category of objects. 
If there is no such plan associated with the node, the default 
estimate is tne only possible answer. 
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{U) Integration procedure . This specifies how to Integrate estimates 
returned from the activated sons to get a unique cuiswer to be 
returned from the current node. This Integration type Is needed 
where, because of ambiguity, more than one son Is activated (that 
Is, the object may have been estimated to belong with positive 
probability to more t^an one subcategory}. 

(5) Text (optioned.) . Describes the rate of the node In the classifica- 
tion tree. This text Is put In by the person or procedure who gener- 
ated the node. 

' The node expansion procedure (ANODE- EXPAND) Is described In detail later In 
the paper. However, It will be outlined here to Justify the data structure of 
the son selection plan. The node expansion procedure operates on one node at a 
time. When a node expansion Is completed, the expanding procedure returns an 
estimated property. This estimate will be the default value associated with the 
node In the case where the node does not have a node expansion plsm or there are 
not sufficient resources to activate the node expansion plan. When the node 
expansion plan Is activated the estimate returned from the node will be either the 
weighted average of the estimates returned from recursive application of the node 
expansion procedure on sons of the node or the value Q ( to be defined shortly) 

If the node expansion plan does not call for son expeuislon. 

The son nodes where they exist correspond to subcategories of the objects 
In the category associated with the node. This finer classification Is made 
based on other properties of the specific structure sinalyzed. Those other 
properties are requested in the node expansion plan stored In the parent node. 

Since these other properties may be nondeterminlstlc, this selection of the 
subcategories may be nondeterminlstlc. In such a case, the object will be 
assumed to belong to different sons (subcategories) with different positive 
probabilities. The property estimate of the answer returned from the parent 
node is the average of the estimates obtained from the activated son weighted by 
the probability that the object belongs to each of the corresponding subcategories. 
The integration procedure specifies which kinds of averaging are used for the node. 
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A node expansion plan contains the following Information: 

(1) An array of R activation records of relations which are used by the 

procedure RRECORD-EXPAND (see Sect. VI-E) (F is an integer associ- 
ated with the node). The i th relation activating record (1 ^ i £ R) 
specifies: (a) tne name of the relation REL [i], (b) the associated 

index SUBJECT (ij (0 <_ SUBJECT [i] < 1) which specifies the objects 
upon which REL [i] operates (SUBJECT [i] ■ 0 means the original 
object euid OBJECT [i] * J, 1£J < i means that REL (i] should be 
applied to the objects satisfying the J^ relation activation record), 
(c) the portion of the resources which will be allocated to compute 
the i th relation activating record out of the total balance of the 
resources available for the node expwsion, (i) the son which should 
be expanded if no object appears to satisfy the relation with proba- 
bility greater than a specific threshold, (e) RHODE [i] which specify 
the mode of operation of RRECORD-EXPAND when it will expand that 
record. 

(2) An array of N attributes activating records (N an integer associated 

with the node). This record is used by ARECCRD-EXPAND (see sect. VI-D). 
The i th attribute activating record specifies: (a) ATT [iJ the 

attribute it activates, (b) an index IND [i] to the objects operated 

on (IND [i] ■ O) corresponds to the original object, 1 £ IND(i) £ 

R means ATT (i] should be applied to the objects computed to satisfy 
IND (i]-th relation), (c) the portion of the balsince of the availablj 
resources that should be allocated to that evaluation, and (d) AMODE 
[i] the mode of applicatic" of ARECORD- EXPAND the objects satisfying 
the IND [i]-th "elation. 

(3) Two arrays: A, which is a N by N real numbers array and B, which is 
a N read number array). When the node is expanded, each of the N 
attribute records is activated and it returns a property value. These 
N values are stored in li element array of values P. If N > 1 (e.g., 
more than one call on ARECORD-EXPAND is made) P(i) is the mean of 

the estimated values which ARECORD-EXPAND returned when N * 1 (only 
one call on ARECORD-EXPAND in that node), P(i) will be the property 
itself. The A and B are used to reduce the N properties into a 
single value Q. 
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A • P + (B • ?) 



— Indicator whether Q is the value to be returned by ANODE_EXPAND . 

The alternative to (U,a) is to have an array of M sons with an asso- 
ciated array of threshold 1 <_ i £ m. are such that 

and T ■ +“». The ith son will be selected to be expanded if Q has 
in 

positive probability of satisfying 

Ti_i < Q 1 

This will mean that there is a positive probability that the object 
at hand belongs to the i th subcat.egory which is associated with the 
i th son. That probability will be the weight given to that son. 

Now since Q can take a range of values with different probabilities, it is 
nondetermini Stic As a result, the object may hav v, positive probability of being 

in more than one subcategory, which will require integrating the estimates 
returned from each son node so as to get a unique answer from the parent node. 
Typically, we use the arithmetic average (weighted by the probabilities that the 
object belongs to the son) of the answers coming back from the different activated 
sons. This implies real nondeteministic son selection. Alternatively, weighted 
geometrical averaging is used which implies that we treat each son's answer as 
an independent estimate. 

V. INFERRED RELATION - COf-IBINATION SEARCHES 

Combination searches are not implemented in the current system; we antici- 
pate organizing them in a search tree. The nodes of a search tree will contain 
a node expansion plan which will be used for resource allocation and expansion 
of the node. The son selection plan data structure organization will be similar 
to the son selection plan used in the classification tree. However, clearly 
there will be no default answer associated with the node (the generic model 
cannot know the specific objects that will satisfy the relation when applied on 
a specific object). Also, the dominant form of integration Df answers from sons 
will be probably to take the union of the objects lists retwU*ned from the 
different activated sons. 


(^,a) 

(»*.b) 
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The default answer of the attribute inference node will most likely be 
replaced in the nodes of the search tree by calls on other (hopefully simpler) 
relations and filters. 

VI. THE CONTROL STRUCTURE OF THE ACCESS OF THE DATA BASE 

Typically an initial access to the da '•.a base is a request for the va.ue of a 
relation or an attribute applied to an object. This request comes from an exter- 
nal user, either a human or another subsystem of the robot system. The exter- 
nal user specifies how much compute time he wishes to allocate to that request. 
This compute time will be allocated for retrieval of the information. Thi.3 
request is immediately translated into the appropriate calls on ATTR_EXPAND 
and REL_EXPAND (sections A and B). From that point on control and execution 
progress in the norma*. \tay (see below). The initial aocess may find an empty 
specific model (all clai>s sets are empty). In this case the object in the 
initial request cf the access is put into the proper objects class in the data 
base and other objects are found in the natural way by expanding relations. 
Descrip’ ion of the 6 recursive procedures which compose the data base access and 
inference process is given immediately below. 

A. THl ATTRIBUTE EXi'AIIDIHCi ROUTINE 

T> first procedure of the data base control is; 

ATTR_B3(PA1I D ( ATTRIBUTE , OBJEoT , RES ) 

It expa; is a request for the property which is the va’ue of the ATTRIBUTE (a 
pointer t j an attribute Ln the generic model) applieu to vBJECT (a pointer to an 
object the specific model ). RES specifies the total resources (machine time) 
allocate i for that teujk. A pointer to the computed property is returned as the 
value ol the procedure and also the a.ssociation ATTRl'iUTE OBJECT»PROPERTY is 
inserteu to the data bas-j. The three major steps of ’,he procedure are: 

(l) Checks the validity of the request. That is, verify that the 

ATTRIBUTE i.< in the generic model, the OBJECT is in the specific 
model and tlie OBJECT belongs to the class of objects upon which the 
attribute operates. 
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(2) Checks whether the data base already contains the association of 
that attribute with that object. If that is the case, a decision is 
made whether to use one of the estimates of the property in the data 
base or to compute a new estimate of that property. The decision is 
made based on the period of validity of the stored estimates, the 
time when the stored estimate was obtained, and the amount of 
resources allocated and used to obtain the existing estimates. 

The idea is that if one of the existing estimates is recent and was 
obtained with about the same or more resources as available now there 
is no point in doing redundant work. In that case, the best exist- 
ing estimate in the data base is returned as the value of the pro- 
cedure immediately. 

(3) The action here depends on the type of the attribute. For a pre- 
programmed attributes, a call is made on the library routine which 
computes th«_ property estimate on the PDP-10 or via the communica- 
tion line on the SPC-16. The value returned by the library routine 
is then stored in the data base (in the proper association) and a 
pointer to it is returned as the value of the procedure. For 
interactive (console) attributes, a request for the veulue is issued 
to the user's terminal. For the inferred attributes, a call on 

ANODE_EXPAHD (ATTRIBU' ■], NODE, OBJECT, A'ITR,riRFS) 

is issued. ( AH0DE_EXPAI1D is the third procedure of the driver and is 
described below.) NODE is the top node of the classification tree of 
that attribute (which is specified in •'he attribute description in 
the generic world model). The OBJECT is the same object as the 
OBJECT In the original call and NRES is the balance of resources 
left after proce‘'^ing steps 1 and 2. The value returned by 
ANODE_EXPAND is taxen as the property value and is stored in the data 
base in the proper associa'tion and a pointer to it is returned as the 
value of ATTR EXPAND in that call. 


JPL Technical Memorandum 33-773 


19 


B. THE RELATION EXPANDING ROUTINE 

The second procedure of the inference system driver is 

RELAT_EXPAND( RELATION .OBJECT , RES , MODE .THRESHOLD ) 

This procedure returns as a value a pointer to the object list (relation value). 
This object list is the list of the objects which appear to satisfy the RELATION 
(which is a pointer to a relation in the generic model) applied to OBJECT (a 
pointer to an object in th.' specific model). RES is the resources allocated for 
that search. MODE specifies the type of call. e.g. . whether the procedure should 
return immediately as soon as an object which satisfies the relation with proba- 
bility higher than THRESHOLD is found or whether it should attempt to find as 
many objects which satisfy the relation exhausting the resources allocated. The 
procedure operates in three steps corresponding to the three steps of ATTR_EXPAND. 

(1) Checks the validity of the call. e.g.. RELATION must be defined in 
the generic model. OBJECT is in the specific model, and belongs to the 
class of objects upon which the relation operates as specified in the 
relation data structure. 

(2) Checks whether the information requested is already substantially 
stored in the data base, ir. which case it returns the stored informa- 
tion immediately. 

( 3 ) Depends on which Lind of relation is being evaluated. If the rela- 
tion is preprogrammed, a calj. on the computing library routine on the 
SPC-I 6 or the PDP-I 6 is made. Where the relation is interactive, a 
console message requesting the list of objects is issued to the oper- 
ator. In the case of inferred relation when it will be implemented, 
a call on the top node of the relation, inference tree node will be 
issued RNODE_EXPAND( NODE, OBJ, RELATION, NRES, MODE, THRESHOLD) corres- 
sponding to the ANODE_EXPAND in the case of inferred properties. Tlie 
value returned by RNODE_EXPAND will be taken as the value of 
RELAT_EXPAND . In either case the object list (the relation value) is 
also stored in the data base in the association RELATION OBJECT* 
OBJECT LIST. 
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THE ROUTINE WHICH EXPANDS A NODE IN AN ATTRIBUTE INFERENCE TREE 


The third recursive procedure of the driver is 

ANODE_EXPAND ATTRIBUTE ( NODE, OBJECT, PARAM, RES) 

This piocedure returns with an estimate of the property values distribution 
represented in the same form as it is represented in a property (except that 
validity time, etc. are not included). The expansion of the node is made in the 
following steps: 

(1) Verifies the validity of the call. Check to see that the NODE actually 
is a valid one and this node is dedicated to the analysis of the 
specified ATTRIBUTE. This check is made only for debugging purposes. 

(2) Checks whether the node should be expanded. If the node is not going 
to be expemded, the value returned by the routine will be the default 
answer stored in the node and no further processing will be made. 
Otherwise, the node expsuision plan will be activated. Decision to 
expand the node is made If two conditions are satisfied. First, the 
node must have a node expansion plan and, secondly, the resources 
allocated to this call of the procedure must exceed a certain 
threshold which is considered minimum for expansion of that node. 

(3) Computes the R relations in the relation array in the node (if R ^ l). 
These relations are evaluated in the order of 1 to R by recursive 
calls on the RRECORD_EXPAND(REL[i] ,OBJAR[SUBJECT[I ]] ,NRES,RMODE(I] , 
THRESHOLD [ I ]) . (RREC0RD_EXFAND is the j> th data base driver of the 
inference system. ) A pointer to the object list returned by the 

i th call on RRECORD_EXPAND whether empty or not is stored in 
OBJAR [i]. OBJAR is an R-element array of pointers to object lists 
associated with the present expansion of the node. The subject on 
which the i th relation operates can be any of the objects already 
pointed at in OBJAR, e.g., SUBJECT[i] must be less than 1. Clearly, 
the first relation must be applied to the original object 'e.g., 

OBJAR [i] = 0) since no other object is pointed to yet. Where there 
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is call on OBJAR[i] ■ 0 a direct call on REL_EXPAND with the 
appropriate vaiiab]?s is issued. If no object appears to satisfy 
the 1 th relation the node expansion will branch to RSON^, which 
corresponds to the subcategory where no object satisfies the 1 th 
relation. NRES is computed to be the portion of the compute time 
left for the node expansion that the plan recommends applying for 
that call. 

(U) Computes the N properties associated with the node. The property 
is computed either by call on ARECORD_EXPAND (the Uth driver 
routine) with the proper parameter, subject, type of call 
and resources; or, if the index is 0, by a call on ATTR_EXPAND 
directly to apply the current attribute to the original object. 

The values returned by the property are stored into a vector 
(array) of property values, P [l:n]. 

(5) Integrates the N values in P into a single property like quantity Q: 

Q=p'^AP + BP 

where A is a two-dimensional array N by N and B a one-dimensional 
array (vector) of N elements. If N=l, Q looks like a typical property 
estimate, that is 



and Valj^^^ > If N > 1 for computational complexity reasons the 

P[i]'s are made deteministic vsiluea which is the average of the 
values in the pi-operty, and hence Q is also made deterministic. 
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(6) It Q i« i»r1c«4 M ilM i«l«w to hm rcrivMd hf tb« w »«psloa pl«a 

that !• rattma^ aa tbe Tidu* of hMfJtft J3^hMt>t 

(7) lA ih« CM« itfhara ih« tteAa aryuaaioa pl«o ealla for aot^noiaa •zptto> 

•ion tb« ttaxt atap i* to nompara tb* ranga of ralxaaa of ^ a 

ll«t of threshold and sous 



SON^ is expanded if the sur* of the prohaHlit/ of Val^ fallln 4 Into 
(Til The sum of probaMllt/ Is the portion of the 

aTSllsble resources for the son expansions bjr recursive call on 
kH')VK_pS'kHV out of the remaining resources* 

(H) The answer returned from the different expanded sons Is integrated 

Iff averaging them and returning that value as the value of that call 
on PNODE_EXPAjlb* The weight of the answer returned from the node is 
the same as the weight used to allocate resources to the sons. 

D. THE ROtfTlHE WHICH rXPAHDG AH ATTRIBUTE ACTIVATIHO RECORD IH H0DE8 
The t« th procedure of the driver system Isi 

ARECORD_EXPAHD ( ATTR , POBJL ,MODE , RES ) 

POBJL Is a pointer of an object list which will be referred to as OBJL. 
ARECORD_EXPAHD starts as the other routine by checking the validity of the call 
for debugging purposes. The next action depends on the MODE In the call. When 
the system was Inplemented originally « there was only one mode of operation 
(Ref. 20) t btjt unfortunately the complexity of the simplest application forced 
us to Implement plurality of modes. In all cases, it returns a property-llke 
value which Is computed in the following ways: 
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Mode 1 ; The attribute ATTR is applied by a call on ATT_EXPAND to each 
object in OBJL with a portion of the resources RES proportional to the 
probability that the object belongs to OBJL. The values returned by those 
calls are added together with proper weights to generate a single 
property-like value returned by ARECORD_EXPAND. 

Mode 2 ; ATTR is applied to all objects in OBJL but the value returned is 
the property of the object whose mean is the maximum among all other 
objects. 

Mode 3 : Same as mode 2 except that the minimum is returned. 

Mode t* : The mean of all values computed by application as in mode 1 is 

returned, e.g. , a single deterministic value which is the mean (average) of 
the property value which would have been returned by similar call with 
Mode 1. 

Mode The varieince of the values computed by application as in mode 1 
is returned. 

Mode 6 ; ATTR is applied onl> to the one object which maximizes the prob- 
ability that it belongs to OBJL among all other objects in the list. 

E. THi. ROUTINE WHICH EXPANDS RELATION RECORD IN NODES 
The 3 th procedure of the driver 

RRECORD__EXPAND ( RELATION , POBJL ,RES .MODE .THRESH ) 

PO’^JL is a pointer to an object list referred to as OBJL. RRECORD_EXPAfID 
will ret’j'-n a pointer to an object list that it generated. 

MOi.*H = 0 means REL_EXPAND is going to be called only once to apply the 
RE-yiTION to the object which maximizes the belong feature among all objects 
in the list pointed to by POBJL. 

MOTH » 1 means REL_EXPAND is going to be applied on all objects in the 
li:.t . The new object list is generated by taking the object which satis- 
fies' each call of hEL_EXPAND with highest probability. 
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MODE » 2 means REL_EXPA1JD is going to be applied on all object? in the 
list. All the object's lists generated are going to be united into a 
single long list. 

F. THE ROUTINE WHICH EXPANDS NODES IN RELATION INFERENCE TREE 

The sixth routine of the driver is RNODE_EXPAND. This routine when 
implemented will be similar to PNODE_EXPAND with two differences: 

(1) If the search operates in the exi.itential mode, then as soon as one 
object which appears to satisfy the relation with high enough prob- 
ability is found, the procedure returns immediately. 

(2) There are no default answers. Instead of the default answer, a node 
may have a call on other relations and a filter property. If there 
is such a relation in the node, it is always evaluated with a portion 
of the resources. Then the filter is applied to those objects which 
satisfy that relation. The filter can have only two values, 0 and 1. 
The weightea average of the two values is taken as the probability 
that the object satisfies the original relation. If that probability 
is high enough, the object is added to the object list. 

VII. PERMANEN'x STORAGE 


The associative data base representing a specific struci ure is meaningless 
without the associated generic model -hich defines the classes of objects, the 
attributes, and the relations. Hence, there are two types of permanent storage 
options on a magnetic disk or tape file. One is the generic model by itself, and 
the other is a generic model coupled with a description of a specific structure 
using the terms defined by the generic model. The system can store files contain- 
ing either kind of data and accept them so as to continue analysis or editing 
from the status as saved. 


JPL Technical Memorandum 33-773 


25 


VIII. MEMORY REFRESH 


We plan on implementing a memory garbage collection mechanism. This mech- 
anism will be called when the data base runs out of storage. It will erase 
properties values euid object lists giving priority according to the following 
factors : 

(1) The amount of resources used to obtain the estimate. 

(2) The length of time left for that information to be valid. 

(3) The time lapsed after the last access for that information. 

IX. CONCLUDING REMARKS 

The foregoing material describes our approach to the representation of 
perceptual information. This system is an evolving effort, and is expanded as 
experience is gained in using the inference capabilities of the data base. 

Control options are added when necessary or when they appear to help convenience 
of use. We believe this work is an improvement on our previous efforts described 
in Refs, h, 17, 20. We consider our major contribution to be the integration 
of the concepts of (l) inference and search bound by time constraints, (2) non- 
deterministic hierarchical inferences, and (3) nondetermlnistic data 
representation. 

Our present goal is to apply the system to image recognition using the low- 
level segmentation routines described in Refs. 13 and lU so as to create a more 
effective system than the one described in Ref. 17. We are also looking for prac- 
tical ways to save the status of inference processei. which exhausted their 
resources so that if additional resources become later available, tne inference 
process may be res\imed from the status it was in when it was terminated. Cur- 
rently, it has to be started from the beginning again, but it can make use of 
any properties and values of relations that are alrt-ady in the data base. 

We also consider the theoretical merit of interrating the resources (compute 
time) available more eiaborately into the node expansion plan. Adiiing such eui 
option may allow more effective and sophisticated use of limited resources in 
special cases. That is, branching to special options where there are very 
limited resources. 
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APPENDIX A 

EXAMPLE OF A GENERIC MODEL 


I. INTRODUCTION 

This section describes a generic model which DABI uses to solve a travers- 
ability problem for the JPL Robot Vehicle, The model is used to obtain an esti- 
mate of whether or not the vehicle can safely occupy a specified location in the 
environment. A complete listing of the model is included at the end of this 
appendix (Table A-l). 

For a location to be classified "safe," several criteria must be satisfied. 
The weight of the vehicle should be nearly equally distributed on all four wheels. 
This implies that the four points which support the wheels should be "nearly" 
planar. The vehicle should be supported at a slope which is acceptable within 
limits imposed by wheel traction, driving and braking power, and the center of 
gravity. Once it has been determined that the vehicle will be adequately sup- 
ported, the area that would be covered by the vehicle in that location must be 
examined for obstacles. The area around each wheel support point is checked 
first to see that the wheels are free of obstacles, then the entire region is 
checked to see if there are any obstacles which would interfere with any other 
part of the vehicle. 

As the classification tree is expanded, each of the above criteria is 
tested as the value of an attribute defined in the model, in the order presented 
above. If each test is satisfied with probability 1, the location is classified 
"safe." If any test fails with probability 1, the location is classified 
"unsafe." Otherwise a value (safe, Pj^)t (unsafe, is assigned to the location 
where P 2 ” 

II. DESCRIPTION OF THE MODEL 


The generic model consists of four data structure type CLASSES, RELATIONS, 
ATTRIBUTES, and NODES. A CLASS stands for a set objects of the s£une type. 
RELATIONS and ATTRIBUTES are mappings f: A B. In either case the domain A is 
a class defined in the generic model. In the case of RELATIONS, B j.s also a 
class defined in the model. For ATTRIBUTES, B is a specified set of integers. 
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Each NODE of the classification tree is described in terms of the relations euid 
attributes to be expanded by that node, and the manner in which the expansion 
proceeds from that node. 

A 3-dimenslonal cartesieui coordinate system fixed in the environment is 
defined such that the x- and y-axes determine a horizontal plane and the positive 
z-axi s points up. All references to the coordinates of a point are with this 
coordinate system in mind. The unit of measurement is inches. 

III. CLASSES 


A. VEHICLE! LOCATION 

An object in this class specifies a vehicle location and is represented by 
an ordered triple (x^, y^, 6 q). The vehicle is at location (x^, y^, 0^) if: 

(1) The coordinates of a fixed point P rigidly attached to the vehicle 
are (x^, y^, z); 

(2) 0Q is the angle formed by the positive x-axis and a vector ^ pointing 
toward the front of the vehicle (see Fig. A-l). 

Implicit in this definition is a rectangular region which contains the projection 
of each point of the vehicle onto the xy-plane. This region will be referred to 
as the vehicle region . 

B. TILE 

The vehicle region corresponding to a vehicle location (x^^, y^, 0^) is 
subdivided into 8 by 8 in. squares or tiles. Each of these subregions is an 
object of class TILE and is specified by the (x,y) coordinates of its center 
point. The four tiles which contain the support points of the wheels will be 
referred to as the wheel t j les . 

C. SAMPLE I POINT 

A reel world surface point (x, y, z) is an object of SAMPLEIPOINT. The 
coordinates of a SAMPLEIPOINT are obtained by the robot sensory instruments, using 
either the LRF (laser range finder) or stereo correlation (Ref. 15). 
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IV. RELATIONS 


SUPPORT ; VEHICLE I LOCATION -► TILE. This relation is preprogrammed to 
return a list of the four wheel tiles corresponding to a vehicle location 
(xq, /q’^O^* list is generated in the fclloving order: right front (wheel), 

right rear, left reeu:, and left front. 

A. WHEELIAREA t TILE TILE 

This relation is preprogramned. This relation is applied to each wheel 
tile and returns a list of nine tiles forming a square with the wheel tile in 
the center (see Fig. A-2). 

B. GET I REGION : VEHICLE 1 LOCATION -*• TILE 

This relation is preprogrammed to return a list of all the tiles covering 
the vehicle region defined by (x^, y^, 9 q). 

C. SAJ»1PLE : TILE -*■ SAMPLE! POINT 

This relation is preprogrammed to drive the sensory instrument to find a 
real world surface point (x, y, z) whose (x, y) coordinates are in the map tile. 

V. ATTRIBUTES 

A. SAFETY ; VEHICLE ! LOCATION -► {1,2} 

The value of this inferred attribute is taken as the estimate of whether 
the location (x^, y^, 6^) is safe or unsafe for the vehicle. The values that 
this attribute can take are 1 and 2, corresponding to safe and unsafe, respec- 
tively. Nodes 1, 3, 6, 7t 9* 10, 11, and 12 are controlled by SAFETY. The 

values computed at each of these nodes are integrated into a single value which 
node 1 returns as the value of SAFETY. 

B. ZCOORD ; SAMPLE! POINT -»• (integers) 

This attribute is preprogrammed to return the z-coordinate of a sample 

point. 
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PLAM£IFIT; VEHICLE I LOCATION {non -negative integers} 


'”his attribute is computed in node 2 using AHECORD_EXPAND. The attribute 
ZCOOP s applied to the sample point of each wheel tile in the order that they 
are generated by the relation SUPPORT. If the wheel tiles are labeled in order 
^1* "^2* "^3* (l ^ i ^ U) the corresponding z-coordinate of T^^ then 

the value of PLANE I FIT can be expressed as 



If the four points are planar, the value of d is 0. Otherwise d represents the 
distance in the z direction from any one point to a plane passing through the 
other three points. Thus d can be thresholded to determine if all fom* wheels 
of the vehicle will be adequately supported at the location (Xq, y^, 0^). 

D. SUPPORT ! VAR ; VEHICLE I LOCATION -*• {non-negat ive integers} 

The value of this attribute is computed in node 3 in a manner slmlleu' to 
PLANEIFIT. The value of SUPPORTIVAR is (max {z^} - min {z^}), where z^, 

1 £ i ^ represents the z-coordinates of the sample points of the four wheel 
tiles as above. This value is a measure of the slope of the vehicle region. 

E. SUPPORT 1 HOT ; VEHICLE! LOCATION -► {integers} 

This attribute is computed in node lU as the average of the 1 i ^ 
(z^ as abtve). 

F. WHELi^lOBST ; TILE {non-negative integers} 

This attribute is computed in node 8. For each wheel tile (obtained by 
SUPPORT), the relation W^-EELIAREA is expanded. ZCOORD is called for the sample 
point of each tile ARECOFD_EXPAND. The value w^^ = max {z} - min {z}, 
i = l<_i^l+is computea for each wheel area. The value of WHEEL lOBST is taken 
as the worst case of w^ over the four uheel areas i.e., 

max |w I 

l<.i^L I 
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A large value of WHEELIOBST Indicates the presence of an obstacle near one of the 
wheels. 

G. HIGH I POINT ; VEHICLE I LOCATION -► {non-negative integers} 

Using the list of all tiles obtained by the relation GETIREGION (in node 13), 
this attribute finds the maximum '-^ordinate taken over the sample points of 
all tiles in the venicle region. The z-coordinates are obtained by successive 
calls to ZCOORD in ARECORD_EXPAND. The difference between HIGH I POINT and 
SUPPORT! HOT is teUcen as an indication of whether or not there are obstacles 
present in the vehicle region. 

H. NODES 

The tree structure (Fig. A-3) is designed to compute the attributes 
described above in the order of increasing amounts of data necessary to compute 
t ?sired value. 

In node 1, PLANEIFIT is computed. This value is used to determine the 
selection of nodes 3 and h. For large values, node 1* is expanded, which i-etarns 
a default answer UNSAFE. 

In node 3 (expanded for small values of PLAIJEIFIT) the value of SUPPORT !VAR 
is obtained and used to determine the selection of nodes 6 and 7. For large 
values, node 7 is expanded which returns a default answer UNSAFE. 

In node 6 (expanded for small values of SUPPORT! VAR) the value of 

WHEEL!OBST is computed, and used to determine the selection of nodes 9 and 10. 

For large values, node 10 is expanded which returns a default answer UNSAFE. 

In node 9 (expanded for small values of WHEEL !0BST) the value of HIGH!P0iNT 

and SUPPORT! HGT are computed. The difference between these two values is used 

to determine the selection of nodes 11 and 12. If difference is large (indicates 
a vehicle obstacle is present), node 12 is expanded which returns a default 
answer UNSAFE. If the difference is -small, node 11 is expanded and returns a 
default answer SAFE. 
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This completes the expansion of the nodes controlled by SAFETY. The 
values at each node are integrated ^d returned by node 1 in the form (SAFE* 
(UNSAFE, Pg) as the value of SAFETY (p^ Pg ■ l). 

■odes 2, 5, 8, 13, and lU are controlled by the attributes PLANEIFIT, 
SUPPORTIVAR, WHEELIOBST, HIGHIPOINT, and SUPPORTIHGT respectively. Eacn of 
these nodes returns the value 

T 

Q-PxAxP + PxB 
as described in section VI-C (6). 
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Table A-1. A generic model for ve^’cle obstacle detection 
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Table A-1 (contd) 
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WHEEL 

TILE 






Fig. A-2. Configuration of tiles 
computed by WHEEL! AREA 



SAFETY (x, y, B) 



Fig. A-3. Safety inference tree 
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APPENDIX B 


AN EXAMPLE OF A SPECIFIC MODEL 

This section presents an application of the generic model described in 
Appendix 1. Table B-1 lists the contents of the associative data base after the 
expansion of SAFETY for the location (x,y,0) = (0,0,0) is complete. The listing 
in Table B-1 consists of three parts: OBJECTS, RELATION VALUES, and ATTRIBUTE 

VALUES. Objects are listed under the class they belong to. The number in 
parentheses after each class name indicates the number of objects present in that 
class. Objects names consists of a letter to help identify the class of the 
object, and the numbers that specify that object to the system. For example, 
S-51!<9!30 (line 300) is the SAMPLE IPO I NT with (x,y,z) coordinates (-5*^9, 30); 
T-5!^9 (line 800) is the TILE centerea at (x,y) -• (-5,^*9); VOIOIO (line 1300) is 
the VEHICLE I LOCATION (x,y,0) = (0,0,0). VOIOIO is defined in tne initial request 
to expand SAFETY of VOIOIO. The objects in classes TILE and SAMPLEIPOINT are 
defined as the result of relation values (SUPPORT and SAI-IPLE) obtained during 
the expansion. 

Relation values are listed starting at line 1500. Each relation defined in 
the generic model is listed with a number in parentheses indicating how many 
objects (subjects) the relation was applied to in this expansion. Each subject 
of the relation is followed by three quantities in parentheses indicating the 
resources allocated and the resources used for the expansion on that subject, and 
the time the value was obtained. For example (line 1700) 6?2 milliseconds 
were allocated to obtain the value of SUPPORT (VOIOIO). The expansion required 
50 milliseconds and the value was obtained at 90:9:28:U6 (day: hour: minute: second, 
with the days counted from Jan. 1, 1976). Under each subject, the objects satis- 
fying tho relation are listed with the corresponding probabilities. Thus the 
value of SUPPORT (VOIOIO) is a list of four (wheel) TILES - T-5I»49, T-IOIIU 9 , 
T-lOlI-7- T-5I-7, each satisfying the relation with probability 1. The relation 
GAI-IPLE (Jine 2300) was applied to four TILES and one SAMPLEIPOINT was obtained 
for each TILE. 

The listing of attribute values follows the same format as the relation 
values with a list of (value, count) pairs under each object instead of (object, 
probability pairs). In the case of SAFETY, names have been defined for the 
range values (l=SAFE, 2=UIiSAFE) and the value name appears (line 5100). 
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The expansion in this excunple Involves nodes 1, 3f and 7 (SAFETY); 

2 ( PLANE 1 FIT); and 5 ( SUPPORT I VAR ) . The relation values for SUPPORT and SAMPLE 
are originally obtained In node 2, along with the value of ZCOORD for each 
SAMPLEIPOINT. Node 2 returns | (30+10) - (30+10)| ■ 0 as the value of PLANEIFIT 
(see Appendix A). This value Is thresholded In Node 1 and the expeuislon pro- 
ceeds to Node 3 which Is expanded for small values of PLANE I FIT. 

The values of SUPPORT, SAMPLE suid ZCOORD are required again In Node 5 to 
compute SUPPORTIVAR. The existing values are retrieved from the associative data 
base and the value 30-10 * 20 Is returned to node 3 as the value of SUPPORTIVAR 
(see Appendix A). This value Is thresholded and the expansion proceeds to node 7 
where It Is assumed that the support slope of the vehicle Is greater than the 
allowable slope. Node 7 returns the value (UNSAFE, 1), which Is ultimately 
returned by node 1 as the value of SAFETY (VOIOlO). 
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Table B-1. A specific model based on the 
generic model of A-1 
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